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INTRODUCTION 


Curing  the  last  few  Tears  there  has  been  much  interest  shown  in 
the  problems  connected  with  the  fluctuation  of  the  sums  of  independent 
and  identically  distributed  random  variables.  Basically  these  prob¬ 
lems  consist  in  finding  the  distribution  of  various  functions  which 
are  definable  in  terms  of  the  sums  and  which  give  a  measure  (in  some 
sense)  of  the  amount  of  oscillation  which  the  sums  undergo. 

Thus  if  {XB}  is  a  sequence  of  independent  and  identically  dis¬ 
tributed  random  variables  and  |Sn]r  the  sequence  of  their  successive 
partial  sums  (i.e.  for  each  positive  integer  n,  Sq  =  X^  +  X^  +•••+  X^) 
then  typical  quantities  investigated  in  fluctuation  theory  are: 

(a)  the  number  of  non-negative  sums  among  the  first  n  sums. 

(»o  ■  0.) 

(b)  the  value  of  the  marl  mum  and  of  the  minimum  of  the  first 

n  sums. 

(o)  the  position  L  where  the  maximum  sum  occurs  for  the  last  time 
nn 

amongst  the  first  n  suns 

(d)  the  value  R^  of  the  sum  which  falls  ]c  from  the  bottom  when 

2 

the  sums  Sq,  S^,...,Sb  are  arranged  in  increasing  order. 

One  of  the  first  definitive  steps  in  the  solution  of  fluctuation 
problems  was  taken  by  E.  S.  Andersen  [1)2,3]  when,  among  other  things, 
he  proved  that  for  |t|  <  1 

(.1)  j?  tnP(Lnn=n)  =  «p(j[  £  Ha*  2  0))  (Loo  =  0) 


^See  Chapter  1  for  exact  description  of  L^.  The  reason  for  the 
notation  will  be  made  dear  in  Chapter  4* 


(.2) 
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oo  « 

Z  t“p(L 

n=0 


nn 


A  short  time  later  Spitzer  [l4]  proved  that  for  |t|  <1,  Re(y)  =  0, 


Re(A)  *  0, 

(.3)  $  tn  ’S 


«p(  2  £  E(.(A4T)Skj  S  iO)) 
k=l  *  * 

exp(  Z  S  <  0)). 

k=l  k  k 


In  this  formula  vie  have  introduced  a  notational  convention  which  will 
be  used  throughout  this  paper.  Namely,  if  A  is  any  event  then  we  shall 
denote 

e**  dP(Sn  *  x)  as  ECe^j  A). 


Implicit  in  (.3)  is  the  following  generalization  of  (.1)  and  (.2) : 
(.4)  j?  tn  Ete^j  tm=n)  =  exp(J?  £  S^.  £  0)) 

for  It  I  <  1  and  Re(A)  £  0 

(.5)  ?  tn  Ete^i  L  =0)  =  exp(  Z  j£  E(e^kj  S  <  0)) 

n=0  m  k=l  k  * 

for  |t|  <  1  and  Re(A)  £  0.3 

A  final  result  to  be  mentioned  at  this  time  is  the  following 
identity  due  to  Wendel  []$] 

(.6)  Z  tn  Z  v^ECe1^4^)  = 
n=0  k=0 

exp(  z’^ECe^)  S.  £0))exp(  Z**^  ECe^j  &  <  0)) 
kFl  *  *  k=l  K  * 

exp(J?  £  B(e(T^)Skj  ^  <0))«q?(JP  £  ECe^j  ^  £  0)) 
for  |t  I  <1,  |v|  £  1,  Re(r)  =  Re(ja)  =  0. 

3 Actually,  («4)  and  («5)  are  equivalent  to  (.3). 
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We  now  can  make  the  following  observation.  In  each  of  the  six 
identities  given  above  the  right  hand  side  consists  of  products  of  the 
functions  g^.(tr,x)  and  g_(tr,x)  for  suitable  rt  and  x  where 

(•7)  g+(",x)  =  ®xp(J^  E(eirSk>  £  0)) 

(.8)  g  (n,x)  =  exp(  E(enSk$  S.  <  0)). 

“  k=l  k  * 

[As  they  stand  here  g+  certainly  makes  sense  for  Re(ir)  <£  0  and  |x|  <  1 
and  g_  is  valid  at  least  for  Re(tr)  £  0  and  |xl  <1,  but  it  nay  be  when 
used  in  formulas  like  ( .1)  to  (.6)  that  the  corresponding  left  hand 
side  nay  only  be  valid  for  Re(ti)  =  0.] 

Identities  which  can  be  written  in  terms  of  the  functions  g+  and 
g__  like  the  six  identities  ( «l)  to  ( .6)  will  be  called  exponential 
identities.  These  exponential  identities  completely  solve  the  problem 
of  finding  the  distribution  of  the  M^,  N&,  etc.  in  a  very  curious  way. 
For  example,  in  the  case  of  Mq  they  show  that  knowledge  of  the 
individual  distributions  of  Sl>  S2»***»Sn  is  enough  to  determine  com¬ 
pletely  the  distribution  of  M^.  This,  of  course,  is  not  what  one 
would  expect  since  the  S^,  1  £  k  ^  n,  are  dependent.  One  would  sus¬ 
pect  that  one  would  have  to  know  the  distribution  of  the  n-dimensional 
vector  (S^,  to  find  Mn.  Similarly  we  will  see  that  the 

other  quantities  8nk-  etc.  share  in  this  properly  of  being 
stochastically  determined  by  means  of  the  individual  distributions 
of  the  S  . 

U 

Another  class  of  identities  related  to  exponential  identities  is 
the  socalled  extremal  factorizations.  In  fact  we  will  see  that  these 
identities  can  be  used  to  prove  certain  exponential  identities  and 
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conversely  can  be  derived  tram,  others.  As  examples  ve  have 


(.9) 

P(Nn  =  k)  =  P(Nk  =  k)P(Nn_k  =  0) 

Andersen  [l] 

(.10) 

p<Lnn  *  *  k)P(Ln-k,^k  =  °> 

Andersen  [l] 

(.11) 

El.**!*]  = 

Wendel  [l8] 

(.9) 

shows,  for  example,  that  knowledge  of  the  two  sequences  of  extreme 

values  {?(Hn  =  0)}  and  {P(Nn  =  n)}  is  enough  to  determine  the  stochastic 
structure  of  {N^J-  completely.  (.11)  shows  that  if  we  know  the  distri¬ 
bution  of  the  extreme  values  and  Individually  for  all  n  then  we 
know  the  distribution  of  any  order  statistic  B^. 

Let  us  briefly  consider  the  methods  used  up  till  now  to  establish 
identities  of  the  type  under  discussion  here.  In  the  main  these  fall 
into  two  classes,  combinatorial  and  analytic. 

The  combinatorial  method  was  initiated  in  fluctuation  studies  by 
Andersen  [l,2,3].  It  was  extended  and  formalized  into  a  definite  prin¬ 
ciple  by  Spitzer  [l4]  and  used  by  him  to  prove  (.3).  Feller  [9]  also 
uses  combinatorial  arguments  and  proves  (.1)  and  (.2) ,  (.4)  and  (.3) 
by  their  use.  This  method  will  be  illustrated  in  Chapter  1  whan  we  use 
it  to  prove  a  theorem,  which  plays  a  central  role  in  our  approach  to 
fluctuation  studies.  This  theorem  was  discovered  by  Andersen  [l]  and 
is  called  the  equivalence  principle  by  Feller  [93  -  A  full  discussion 
of  it  will  be  found  in  Chapter  1  and  it  will  suffice  here  to  say  that 

the  theorem  asserts  the  fact  that  5  and  L _  are  stochastically 

n  nn 

equivalent. 

The  analytic  method  was  developed  by  several  people  independently 
of  each  other  and  takes  different  forms  according  to  each  of  these  in¬ 
dividual  author#1  development.  It  turns  out  that  these  various  methods 
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are  all  equivalent  and  one  such  net  hod  is  presented  for  illustrative 
purposes  in  Chapter  6.  This  method,  based  on  Liouville's  theorem  of 
analytic  function  theory,  seems  to  have  first  been  used  in  fluctuation 
problems  by  D.  Ray  [13]  but  was  developed  independently  by  Ray  and 
Kempeman.  Kemperman  [ll]  discusses  the  method  in  detail*  The  method 
came  to  my  attention  by  way  of  M.  Dwass  (who  used  it  to  prove  the 
spepial  case  of  (*3)  with  Y  =  0) .  Other  people  who  develop  analytic 
approaches  are  Vendel  [l7,l$]  and  Baxter  [4,5,6]. 

Vendel's  approach  is  to  formulate  the  problem  in  terms  of  solving 
certain  equations  on  a  Banach  algebra  and  then  shoving  that  these  equa¬ 
tions  have  solutions  which  result  in  the  identity  in  question.  For 
details  we  must  refer  the  reader  to  Uendel's  papers. 

Baxter's  approach  is  similar  and  amounts  to  shoving  that  certain 
operator  equations  on  a  function-Banach  space  have  as  their  unique 
solutions  the  respective  right  hand  side  of  the  identity  in  question. 
Here  too  we  must  refer  the  reader  to  Baxter's  papers  for  details 
(see  especially  [6]). 

Our  approach  to  these  identities  will  be  to  show  that  all  known 
identities  are  derivable  frost  (.4)  and  (.5)  by  means  of  simple  and 
completely  elementary  considerations  with  use  of  the  equivalence  prin¬ 
ciple  to  change  from  oertain  assertions  about  to  and  conversely. 
In  faot  we  will  show  that  all  known  Identities  are  actually  special 
cases  of  one  large  identity  (see  (.28)  for  this  identity) . 

He  also  will  demonstrate  that  (.4)  and  (.5)  can  be  derived  by  a 
simple  completely  elementary  probabilistic  argument  (having  its  basis 
in  recurrent  event  theory)  with  the  aid  of  the  equivalence  principle. 

In  fact,  one  purpose  of  this  paper  is  to  show  that  the  salient  facts 
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of  these  fluctuation  studies  are  contained  in 

(1)  the  Equivalence  Principle 

(2)  the  fact  that  "ladder  indices"  are  recurrent  events.^- 

Let  us  be  a  bit  more  specific.  An  index  n  is  called  a  ladder  index 
for  the  sums  {S^  (or  just  a  ladder  index,  (respec.  point))  if  S^  £  S^, 

0  *  j  <  k.  In  other  words  n  is  a  ladder  point  if  is  at  least  as 
great  as  the  previous  sums.  It  is  easy  to  verify  that  ladder  indices 
are  recurrent  events  (see  Chapter  2).  Let  be  the  associated  se¬ 
quence  of  waiting  times  (i.e.  +***+  =  time  of  k^1  occurrence 

of  the  recurrent  event). 

For  an  arbitrary  recurrent  event  e,  let  yQ  =  0  and  for  n  >  0  let 

yB  denote  the  time  at  n  of  the  last  occurrence  of  e.  In  other  words 

if  0  <  k  <  n  then  v  =  k  if  e  occurs  at  k  but  does  not  recur  until 
n 

after  time  n.  Observe  in  particular  that  if  e  does  not  occur  during 

the  first  n  steps  then  y  =  0.  On  the  other  hand  if  e  occurs  at  time 

n  then  y  =  n.  As  a  recurrent  event  "starts  from  scratch"  at  each 
•'n 

occurrence  we  have  that 


(.12) 

rty„  =  d  =  p[yk  =  k]p(yn_k  =  o) 

also 

(.13) 

>  n]  =  P[yn  =  0] 

(.H) 

P[e  at  n]  =  P[yn  =  a]. 

The 

5 

two  basic  relations  of  recurrent  event  theory  are 

(.15) 

Z  tnP(y  =  n)  =  - =  P(t) 

n=0  n  1  -  Et  1 

|t|  <  1 

These  will  be  defined  below.  They  were  first  used  by  Blackwell 
[7].  Feller  [9]  uses  them  in  Fluctuation  Studies.  Their  use  was  sug¬ 
gested  to  me  by  M.  Dvass  (see  Chapter  2). 

5See  Feller  (10], 
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i.16)  jP  =  0)  =  |t|  <  1 

and  so  from  (.12)  and  (.15)  and  (.16)  we  have  for  |x|  £  1  and  |t|  <  1 
that 


Differentiate  (.17)  with  respect  po  x  at  x  -  1.  This  results  in 


(.18) 


P(0)  =  1 


having  as  its  unique  solution 

(.19)  P(t)  =  exp(J?  £  E[yk  -  y^]).6 


This  curious  "exponential  representation"  was  shown  to  the  author  by 

V 

M.  Dwass.  It  shows  that  P(t)  (and  hence  Et  ^)  is  completely  determined 
by  the  sequence  {Eyjf .  Its  use  is  dependent  on  how  easy  It  is  to  find 
Ey^,  for  all  k. 

For  the  particular  event  "ladder  index"  a  little  reflection  will 

show  that  y_  for  this  event  is  just  L _ ,  and  so  we  need  find  EL  . 

n  nn'  nn 

But  this  is  just  where  the  equivalence  principle  is  of  use,  for  it 


tells  us  that 


ELnn  =  88  . z.  HSv  2  0) 


kFl 


and  thus  use  of  this  fact  in  (.19)  results  in  (.1),  (i.e.  Andersen's 
lemma).  From  (.1),  (.2)  can  de  deduced,  for 


1-t 


(.20) 


=  =  «p(?  A 

k=l  * 

k  k 

=  exp(z\P(Sk^0))exp(2^P(Sk<0)) 


ie  Chapter  2  for  analytic  details. 
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And  by  ( .15)  and  ( .16) 

(.21)  [  Z  t”P(y_  =  0)][  “  t“P(y  =  n)]  =  .  7 

,n=0  n  n=0  n  z 


Let  ns  now  briefly  summarize  the  contents  of  this  paper* 

Chapter  1  states  a  permutation  version  of  the  equivalence  prin¬ 
ciple  and  gives  its  proof,  then  uses  the  Spitzer  method  to  prove  the 
corresponding  probabilistic  version. 

Chapter  2  is  devoted  to  the  extension  of  the  recurrent  event 

facts  presented  in  the  introduction  roughly  along  the  lines  of  incor- 

ASr»  8 

porating  the  quantity  e  n.  These  extended  recurrent  event  relations 
are  used  to  prove  (*4)  and  (*5)  by  an  argument  which  is  completely 
analogous  to  the  argument  used  to  derive  («l)  and  (.2).  A  second 
proof  is  given  of  (.4)  and  (.5)  which  will  show  that  (*4)  and  (.5) 
and  (.1)  and  (.2)  are  equivalent.  The  chapter  ends  with  the  following 
theorem 


:.22)  f 


n=0 


1  -  tq>(p)  1-  yE(e^^^Z3-(xt)^T 


where  T&  denotes  the  number  of  ladder  points  at  time  n  (see  Chapter  2 
for  definition). 


Chapter  3  is  devoted  to  the  systematic  deduction  of  theorems  which 
follow  more  or  less  directly  from  the  basic  identity.  Same  of  the 
more  important  of  these  are 

(.23)  Bte*21  tMl)  =  1  -  exp(-j?  £  Ke*3^  Sk  £  0)) 

(Baxter  [4])  Spitzer  [16]) 

7 

'This  observation  is  due  to  Du&ss. 


^Por 
Theorem  2* 


the  precise  nature  of  these  extensions,  see  Chapter  2, 
4. 


(-24)  =  g*U;xt)t_(Ajt)  =  H(A)Xft) 

(Andersen  [3],  Baxter  [6],  Wendel  [IB]) 

(.25)  ?  tnE(eA3n+)*B  x**)  *  g.(A+p$xt)g  (A;t) 

B&)  ~ 

(ease  x  -  1,  Spitzer  [14],  Wendel  [17],  Baxter  [4*6] >  Duass  [private 
correspondence] ) 

(•26)  ?  tVe*3®  xNnj  Sn  *  0)  *  {l  -  [l-  t9(A)]H(A|x,t)} 

(Andersen  Ij],  Baxter  [6]) 

(•27)  r  *<.*»♦ 

n=0 

_  [l  -  £frP.(A  ^]H(a + p;  x,  t)  -  [1  -  t?(p + p )  ]H(p + p  jx,t) . 


In  Chapter  4  we  introduce  the  notion  of  order.  We  order  the 


partial  subs  So»  3i>*-isn  by  the  following  order  relation  ^  where 


3k<Sj  If 


f  \  <  Sj  or 
1  ^  but  k  <  j. 


With  this  ordering  there  can  be  no  ties;  each  sum  stands  In  a  unique 
position  In  relation  to  increasing  order.  Let  denote  the  index 
of  the  sum  which  stands  kth  from  the  bottom  in  the  -<  order  and  let 


be  that  sub.  The  aaln  theorem  of  Chapter  4  Is  theorem  4*3  vhleh 

says  _  + 

1  t-  1 

nf=0  k=0 

( .28)  *  I*" y)'  g^(A+  p  +y,n t r)g_(A+  p*  r»«*) 

-  j^Ci-utf(p+ r+  P)]g+(p+r+ P;utr)g_(p+ r+  Pj*t)} 
•g+(p»t)gjp,tr). 
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This  theorem  is  new  but  many  special  cases  of  It  hare  been  derived  by- 
other  people.  Many  of  these  will  be  derived  in  Chapter  4* 

Chapter  5  starts  with  an  alternate  proof  of  the  important  special 
ewe  of  (.28)  with  A  =  p  =  0.  This  proof  has  at  its  basis  the  follow¬ 
ing  factorisation: 

(.29)  =  Jit.1®1**  ^  »Vk’°) 

[the  special  case  of  u  *  1  is  due  to  Wendel]. 

Froai  (.29)  we  prove  a  corresponding  permutation  identity  and  conclude 
the  chapter  with  an  example  of  this  permutation  identity. 

Chapter  6  presents  an  alternate  derivation  of  the  basic  identity 
and  (.24)  by  using  complex  variable  arguments.  Ve  then  show  that  the 
oonbinatorlal  identity  equivalence  principle  can  be  derived  from  these 
two  theorems. 


Chapter  1 

Equivalence  Principle  and  the  Combinatorial  Method 

Ut  1  °  bv*2’"  •  jJjj)  be  an  arbitrary  n- tuple  of  real  numbers. 

The  numbers 

s0(7)  =  0, 

V*>*v»2*  —  1  i  k  i  “* 

are  called  the  partial  sums  of  y,  S^(y)  being  the  k*b  partial  sum. 
imong  the  n  sums  9o(y),...,Sn(y)  let 

(1.1)  H^(y)  —  the  number  which  are  non-negative , 

(1.2)  Hn(y)  =  the  number  which  are  positive , 

(1*3)  NQ(y)  =  the  number  which  are  negative, 

(1*4)  In(y)  =  the  number  which  are  non-positive. 

A  word  about  notation:  in  the  future,  if  f(y)  is  a  function  whose 
argueent  is  an  n-tuple  y  we  will  omit  y  and  write  just  f  if  no  confusion 
is  possible  about  what  the  argument  of  f  is.  Thus  in  the  above  we 
would  write  Sk  instead  of  S^y),  Nn  in  place  of  l»n(y),  etc. 

The  partial  sums  Sq,  S^,...,Sn  are  said  to  have  a  first  HxjjUi 
fii  position  k,  (0  £  k  *  n),  if 

sk  >  sj,  0  £  j  £  k  and  sk  Z  sj»  k  <  1  £  n. 

Similarly,  the  sums  are  said  to  have  a  last  igSifflB  A&  fifilijciSB  k 

(o  i  k  i  m)  if 

S^S^,  J  <k  and  Sk  >  k  <  h  £  n. 

Me  say  that  the  partial  suss  SQ,  ^,...,8  have  a  first  (respee.  2jy&) 
alnlBll  ai  k  if  the  partial  sums  of  (•71,-y2» have  a  first 
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(respec.  last)  — arlirnm  at  position  k.  In  the  sequel  we  shall  denote  by 

(1.5)  L^,  the  position  of  the  last  marl  mum, 

(1.6)  L^,  the  position  of  the  first  maximum, 

(1.7)  Lno,  the  position  of  the  first  mini  mm, 

(1.8)  Lq,  the  position  of  the  last  minimum. 

(12  Q  \ 

c*2  •  ••  0  )  (l»2,...,n). 

For  each  such  permutation  and  eaoh  n-tuple  y  =  (y^,y2,...,yn)  define 

a  new  n-tuple  C!y  as  dy  =  (yd  >7o0  >  •  •  •  »70  )• 

j.  4  n 

Consider  a  fixed  n-tuple  y  and  let  1  denote  the  set  of  all  n! 
images  of  y  as  d  runs  orer  the  ni  permutations  of  (l,2,...,n).  He  can 
make  1  into  a  probability  space  by  assigning  to  eaoh  1  point  subset  of 
A  the  probability  1/nl .  Eaoh  rearrangement  dy  of  y  can  then  be  thought 
of  as  a  value  of  a  random  vector  I  =  (X^,...,Ia)  which  is  defined  on 
A  and  the  partial  sums  of  dy  as  a  value  of  the  partial  sums  of  X. 
Likewise  the  values,  Hn(dy),  Ln(dy),  etc.  can  be  thought  of  as  par** 
tieular  values  of  the  random  variables  H  (X).  L  (X) ,  etc. 

It  is  clear  that,  for  example,  P(lB(X)  =  k)n!  is  just  the  number 
of  permutations  d  which  have  the  effeot  that  among  the  partial  sums, 
Sj(dy) , . . .  ,Sn(dy)  there  are  exactly  k  which  are  non-negative.  Some¬ 
what  more  formally  we  may  write  that 

p(.,(D  =  u  =  i,  * 

where  I  (dy)  -  f  1  if  among  the  partial  sums  of  dy  there  are 
[g  =  fc]  I  k  non-negative  ones, 
n  ^  0  otherwise. 

(1.1)  THEOREM  (EQUIVALENCE  PR INC IP  IE) 

Let  y  be  a  given  n-tuple  of  real  numbers  (y^,y2, • • • ,yn)  •  Then 
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(1.9) 

P(Nn  =  k) 

— 

P(IW  “ 

(1.10) 

P(Hn*=  10 

= 

P(ln  =■  k> 

(1.11) 

P<V=  « 

= 

P(1no  *  *> 

(1.12) 

P(*B  «  k) 

s 

p(rn  " 

(1.13) 

P(I.n  =  k) 

= 

P(L.  »  n-k) 
n 

(1.14) 

P<Lnn=k> 

= 

P(Lm  =  n-k). 

Before  proving  this  theorem  we  shall  illustrate  it  by  means  of 

1,2  E-rMmlfl ;  y  =  (-2,7,-8,l). 


There  are  24  rearrangements  of  y. 


-27-81  -25  -3  -2  1  2  3  1  2 

-271-8  -256-2  2  3  4  2  3 

-2  1  -8  7  -2  -1  -9  -2  0  0  3  0  0 

-2  -8  7  1  -2  -10  -3  -2  0  0  2  0  0 

-2  -8  1  7  -2  -10  -9  -2  0  0  2  0  0 

-2  17-8  -2-16-2  1  3  1  1  3 

7-2-81  75-3-5  2  1  3  2  1 

7-21-8  756-2  3  1  4  31 

71-2-8  786  -2  3  2  4  3  2 

71-8  -2  780  -2  3  2  4  2  2 

7-81-2  7  -1  0-2  2  1  4  1  1 

7-8-21  7  -1-3  -2  l  1  3  1  1 

-871-2  -8-10-2  1  3  1 

-87-21  -8  -1  -3  -2  0  0  1 

-8  -2  7  1  -8  -10  -3  -2  0  0  2 

-8-217  -8  -10  -9-2  0  0  2 

-81-27  -8  -7  -9-2  0  0  3 

-817-2  -8-7  0-2  1  3  1 

17-8-2  180-2  3  2  4 

17-2-8  186-2  3  2  4 

1-2-87  1-1  -9  -2  1  1  3 

1-27-8  1  -1  6-2  2  3  4 

187-2  1  -7  0-2  2  1  2 

18-27  1-7  -9  -2  ljl  3 

Nov  count  the  number  of  permutations  which  yield  values  0,1, 2, 3, 4 

for  the  quantities  involved  and  divide  by  24.  This  gives 


OOOOOO  NPNHNHH 
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p(n4  =  0) 

= 

7/24 

p<L44  -  0) 

= 

7/24 

P<Lo4  =  0) 

= 

0 

p(n4  =  1) 

s 

7/24 

P(L44  ’  11 

s 

7/24 

p(L04  =  l> 

= 

5/24 

P(N4  =  2) 

= 

5/24 

■  2> 

= 

5/24 

P(Lo4  *  2) 

s 

5/24 

P(H3  =  3) 

= 

5/24 

p(lU  *  3) 

= 

5/24 

P<Lo4  ■  3) 

= 

7/24 

II 

= 

0 

p<L44  *  4) 

0 

P(io4  =  4) 

3 

7/24 

p(n4+=  0) 

3 

9/24 

p(l4  =  0) 

= 

9/24 

H 

II 

+  ■ 

PL, 

= 

7/24 

p(L4  =  1) 

= 

7/24 

P(N4+-  2) 

S 

5/24 

P(L4  =  2) 

= 

5/24 

11 

V 

PL, 

= 

3/24 

P(L4  =  3) 

= 

3/24 

p(n4+=  4) 

= 

0 

p(l4  ■  4) 

= 

0 

from  which, 

in  this  case, 

we  see  the  assertions 

of  the  theorem  are 

valid. 


Proof  of  theorem: 

First  we  establish  (1.13)  and  (1.14) 


f1  2  —  ?).  Then 
(n  n-1  •  ••  1/ 


'VX  =  ( 


Wi’"' 


.  Let  x  be  the  permutation 


,3^)  and 


(1*15)  L  (x)  =  n  -  L  (tx) 

n  n 

(1.16)  L  (x)  =  n  -  L  (tx) 

nn  no 

from  which  (1.13)  and  (1*14)  are  evident.  To  prove  the  assertions 
(1.9)  to  (1.12)  we  proceed  by  induction  on  n.  For  n  =  1  these  asser¬ 
tions  are  obvious,  so  suppose  that  we  have  established  these  relations 
for  all  n-1 -tuples  of  real  numbers.  To  show  that  they  hold  for  all 
n-tuples  we  must  consider  three  cases. 

Case  i:  y^  +  yg  +  •••  +  7n  <  0. 

In  this  case  it  is  impossible  for  the  quantities  Nn,  L^,  LnTi, 

and  Nq+  to  assume  the  value  n,  and  so  for  0  £  k  £  n-1  we  have  by 
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hypothesis 

P(»n  =  k|ln  -  7j)  =■  f(lm  =  lc|In  »  7j), 

P(H»+“  k|Xn  =  7j>  =  P(Ln  =  k|ln  =  7j). 

Hence  as  P(Xn  =  y^)  =  1/n,  1  £  3  £  n,  w®  have  shown  that  (1.9)  and 
(l.lO)  hold  in  this  case. 

To  establish  (l.ll)  and  (1.12)  we  use  the  equations 

(1.17)  P(N  '  =  k)  =  P(N  =  n-k)  =  P(L  =  n-k)  =  P(L  =  k), 

n  n  nn  no  9 

(1.18)  P(H_ '  =  k)  =  P(H  +  =  n-k)  =  P(L  =  n-k)  =  P(I  =  k). 

n  n  n  n 

The  last  equations  in,,(l.l7)  and  (1.18)  follow  from  (1.13)  and  (1.14). 
Case  ii:  y^  +  y2  +...+  yQ  >  0t 

The  argument  used  in  case  i  shows  the  validity  of  (1*13)  and  (1.14) 
in  this  case  and  (1.9)  and  (l.lO)  follow  by  use  of  (1.17)  and  (1.18) 
(from  the  outside  in,  in  this  case). 

Case  iii:  yx  +  ...  +  yn  =  0. 

The  argument  used  in  case  i  to  establish  (1.10)  is  valid  in  this 
case  as  well,  and  applying  (1.18)  establishes  (1.12)  in  this  case  too. 
Similarly  the  corresponding  argument  used  in  case  ii  is  valid  in  this 
case  to  establish  (l.U)  and  (1.17)  now  establishes  (1.10)  in  this  case. 

Hence  relations  (1.9)  to  (1.12)  are  valid  for  all  n- tuples  and 
the  theorem  is  proved. 

This  theorem  was  first  proved  by  E.  S.  Andersen  in  [l] .  The 
present  formulation  is  due  to  Feller  and  the  proof  is  essentially  the 
proof  presented  by  him  in  [9]  with  minor  corrections. 

We  now  extend  the  equivalence  principle  to  a  certain  class  of 
random  variables  called  interchangeable  which  have  the  property  of 
being  invariant  under  permutations.  In  precise  terms  ws  have 


I«3  Daf  lnl  -M  np .  n  random  variables  X^  r^2  ’  *  *  *  ’\i  are  1  inter¬ 
changeable  (symmetrically  dependent)  if  the  joint  probability  distribu¬ 
tion  of  X^  '*'s  a  s7inra6'tric  function  of  X^,  Xg,...,!^ 

1*4  SaUBBlft*  If  X  =  (X^,X2,...,Xa)  are  the  nl  rearrangements  of  a 
fixed  n-tuple  y  of  real  numbers  then  the  X^jXg,...,!^  are  inter¬ 
changeable  • 

1.5  Definjtiqn.  A  sequence  {Xn|  ,  n  £  1,  of  random  variables  is 
called  interchangeable  if  for  any  n  >  0  the  random  variables 
Xl,X2,**‘,*n  are  ^terehangeable. 


1.6  E-gnmnl  a  -  K  {V-  -  *  !.  are  independent  and  identically  dis¬ 
tributed  random  variables  then  {X^j  is  interchangeable. 

1.7  THEOREM 

Let  X  =  be  interchangeable  and  let  fn(X)  be  a 


symmetric  function 

V 

Then  for 

(1.19) 

E[f„i 

k]  = 

■k], 

(1.20) 

li 

k]  = 

Etfn* 

L  = 
n 

s  k]» 

(1.21) 

E[f„S 

N  "  = 
n 

k]  = 

E[f„i 

Lno 

=  k], 

(1.22) 

*n  = 

k]  = 

V 

=  k]. 

(1.23) 

ECfni 

k]  = 

EtEnS 

L  = 
n 

=  n-k], 

(1.24) 

E['»i 

Lnn  = 

k]  = 

EtE„s 

L 

no 

=  n-k]. 

Proofs 

As  the  proofs  of  all  of  these  assertions  are  very  similar  we 
shall  prove  only  (1.19). 


where  p(x)  is  the  distribution  of  X.  By  (l«9)> 
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X  I  (tfx) 

*  [N  =  k] 


=  21  (Ox)  _ 

[L  =  3c] 
nn 


and  so  the  right  hand  side  of  (2*25)  can  be  written  as 


§  il  J  I[L<0?)k]d,l(l)  =  J'fn(x)  '  ECfn>Lm=k:1- 

nn  nn  J 

Note.  This  mode  of  argument  from  a  permutation  identity  to  an  identity 
on  interchangeable  random  variables  is  due  to  Spitzer,  and  was  ex¬ 
plicitly  formulated  in  []/.] . 

AS_ 

The  particular  case  of  f  =  e  will  be  of  constant  use  and  we 
list  here  those  formulas  which  we  will  need  in  the  future. 


(1.26) 

_/  ASn 
E(e  n; 

N  = 
n 

k) 

L 

nn 

=  k) 

(1.27) 

Ete^j 

+ 

N  = 
n 

k] 

£ 

® 

w* 

tl 

L  = 
n 

■u, 

(1.28) 

v= 

k] 

=  Ete^i 

L 

no 

=  k] 

(1.29) 

Lnn  = 

=  0] 

=  Et.^j 

L 

no 

=  n] 

(1.30) 

E[."S 

Lm= 

n] 

= 

L 

no 

=  0] 

where  these  are  certainly  valid  for  A  complex  and  Re  (A)  =  0. 

Ranarlcs.  The  method  used  to  deduce  theorem  1.7  (i.e.  by  a  direct  use  of 
the  permutation  identity  I.l)  is  typical  of  the  combinatorial  method. 


What  one  does,  in  general,  is  to  find  a  permutation  identity  which  when 
used  in  an  argument  similar  to  that  used  in  the  proof  of  theorem  1.7 
results  in  a  desired  probability  identity.  The  difficulty  with  this 
approach  is  that  there  is  not  a  systematic  method  which  enables  one  to 
find  these  permutation  identities  and  that  the  proofs  of  these  permu¬ 
tation  identities  may  not  be  easy.  [For  other  permutation  identities 
see  Spitzer  [l4]>  equation  (2.24)  of  Chapter  2,  and  theorem  5.2  of 
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Chapter  5.] 

As  will  he  seen  in  the  sequel  the  various  permutation  identities 
can  he  derived  from  their  corresponding  probability  identities  and 
thus  the  combinatorial  method  is  equivalent  to  the  various  methods 
which  have  been  developed. 


Chapter  2 

The  Basic  Identity 

Let  {In>  be  a  sequence  of  random  variables  and  let  their  successive 
partial  sums  be  denoted  by  {Sn}.  As  usual  we  define  Sq  =  0. 

2.1  Defiirl-M nn.  A  positive  integer  n  is  called  a  ladder  point  (index) 
of  the  sums  {S^  if 

(2.D  s„isj.  °SJ<". 

that  is,  if  the  sum  is  at  least  as  great  as  the  previous  ones*  If 
^1,^2,**‘  are  successive  waiting  times  for  ladder  points  then  it 
is  easy  to  see  that  the  {WjJ  are  just  the  waiting  times  for  new  partial 
sums  which  are  at  least  as  great  as  their  predecessors.  Let  {Z^J-  be 
the  successive  differences  between  these  "world  record"  sums* 

More  precisely  let  -Q  be  the  probability  space  of  the  -{X  Y  and 
define 

A^  =  [u  Efl  :3n  >  0  such  that  n  is  a  ladder  point  of  {Sj^wJJr]. 
For  u  e  A^  define 

H^(u)  =  lnf[n  >0:  n  1b  a  ladder  point  of  {S^(u)][] 

Zl(u)  =  ^(u)^* 

For  ued  -  A^  we  define  W^(w)  =  oo  and  do  not  define  Z^.  Suppose  now 
that  we  have  already  defined  events  A^jAj, . •  •  ,An,  and  random  variables 

then  define 

An+j,  =  [w  e  A^On  >  V^(u)  +•••+  W^Cu)  such  that  Sq(u)  is  a  ladder 
point  of  {Sk(u)}]. 

If  u  E  A^+^  define 
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Wn+^(u)  -  inf  [n  >  W^(u)  +  •••+  Wn(w):  n  is  a  ladder  point  of 

and  Znn(u)  =  U»)  „  (u)  -  (Z^u)  ♦•••♦  *>». 

1  n+l 

If  u  eil  -  An+^  define  Vn+^(y)  =  oo  and  do  not  define  on  this 
set.  We  have  consequently 

nDAl=5A2D 

Z.,... >Z  are  defined  on  A  and  W, , . . .  are  finite  on  A  . 
n  n  x  n  n 

2.2  Definition.  The  sequence  are  called  the  successive  waiting 

tines  for  ladder  points j  tf^  +  +...+  W^  being  the  waiting  tine  for 

the  kth  ladder  point.  For  convenience  define  W  =  Z  =0. 

0  0 

From  now  on  unless  otherwise  specified,  we  will  take  the  {i^  to 
be  in^s.pandffnt  and  idontinaTiv  digjgjJaitefl*  On  the  sums  of  such  a 
sequence  we  have  that 

2.3  THEOREM 

If  Aq  are  as  defined  above  and  if  the  are  Independent  and 
identically  distributed  then  {(Z^W^))"  are  independent  and  identically 
distributed  on  their  domains  of  definition. 

Proofs 

Suppose  we  have  established  the  assertion  in  the  theorem  for 
a  =  1,2, ... ,n.  Then  if  k^,...,kn+^  are  am  n+l  finite  positive  in¬ 
tegers,  B  any  borel  set,  we  have 

P*Wn+l  =  kn+l>  Zn+1  8  BIW1  =  kl’*"’Wn  =  kn»  Z1»,#,»V 


=  P[IV1<0>' 


”\+l 


. W<0’°*V 


+•••+  X 


Wi 


=  <  °,.*.^kn+1-l<0,  +•••*  \+1  e  B) 

=  p(w!  =  kn+1,  \  e  B),  where  tfl  =  ^  +  kg  +•••+  kn« 
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Thus 

P(Vl  ■  W  Zn*l  6  BlAn>  =  P<W1  ■  Vl-  Z1  e  B>- 

Likewise  we  have 

P(Vl  =  “IV  =p<»i*oo). 

Ilu»  w»  km  for  an}'  a,  {(UpZj)  ...  (Wn,ZD))  are  independent  where 
defined  and  on  Aq,  (Wn+^,Zn+^)  has  the  same  distribntion  as  (W^,Z^)  does 
on  Q  . 

In  the  sequel  when  we  write  E[e^Zl+“*+  Zn)tWl+**,+Wa]  m  wlll 
■ean  l[e  ^  1  •  •  •  ^1  n  j  #  The  theorem  then  says  that 

where  |t|  <  1  and  Re(A)  =  0. 

In  particular  the  sequence  {W^j.  are  a  sequence  of  "waiting  tines" 
for  a  recurrent  event  in  the  sense  of  Feller  j  which  of  course  shows  that 
ladder  points  are  themselves  a  recurrent  event.  [See  [l0]  for  details 
on  recurrent  events.] 

By  definition  of  the  quantities  involved  we  have  that 
(2*2)  [lf^  >  n]  —  [S1  <  0j...jSn  <  0]  =  [Lj^ )t>. jl^)  =  0] 

(2.3)  =  n]  =  [S^  £  Sjj  0  ^  J  <  n] 

=  [n  is  a  ladder  point]. 

2.4  THEOREM 


let  A,t  be  complex  numbers  such  that  Re(A)  =0,  |t|  <1  and  let 
?(A)  *  Be^l.  Then 


(2.4) 


- fev  ¥Vv  =  Z  ECe^i  L  =  n)tn  (L  =  0) 

l-E(eAi&l  t"l)  n=0  ’  nn  00 

l-BC^1  tWl)  =  J®  Efe^j  L  =  0)tn,  (L  =  0). 
1  -  tq>(A)  n=0  m  0° 


(2.5) 
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Proof: 

We  first  prove  (2.4).  As  Eje  ^  t  "M  <  1  and  the  {(W^jZ^)}-  are 
independent  and  identically  distributed  (by  theorem  2.3)  we  have  that 

(2.6)  -  -  l  .  |  E(.Wl  tV  =  ? 

l-E(eAZl  t"1)  k=0  k*) 

Nov  as 

X  =  j°  A[.AZ^-^))wr...«k.n] 

and  +...+  Z^  =  if  +...+  =  n  ve  have  that  the  right  hand 

side  of  (2.6)  can  be  written  as 

(2.7)  2?  {  £  tnE(eASnjW1+...+  W.  =  n)}  =  £  tn  ?  E(eASn}W-+...t-W.  =n) 

k=0  ln=0  1  *  '  n=0  k=0  x  * 

where  the  exchange  in  the  order  of  summation  is  valid  sinoe 

Z  I  |t|n  ^(e^;  V.  +...+  W.  =  n)  <  oo 
k  n  -L 

but 

(2.8)  J?  £(6^}  W1  W^n)  =  EU^j  =  n) 

since  a  last  must  occur  at  sene  ladder  point.  Combining  (2.6), 

(2.7)  and  (2.8)  yields  (2.4). 

To  prove  (2.5)  observe  that 


oo 


[l  -  -bcp(A)]  JL  E(eASnj  Lm  ■  0)t* 


un 


.n+l 


=  V=0)  -  E<eA3”n*  «“ 

tinoe  fM  =  E*'^n+-  and  In+^  is  independent  of  X^, . . .  ,1^.  Bat 


[^  =  0]  =  [«!  >  n] 


and  so  the  last  expression  can  be  written  as 

1  -  ?  Efe^i  Wx  =  n)tn  =  1  -  E(eAZl  tWl). 
n=l  A 

This  establishes  (2*5). 
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If  equations  (2.4)  and  (2.5)  are  compared  with  equations  (.15)  and 

(.16)  we  see  that  they  contain  these  (for  the  ladder  point  recurrent 

event)  as  a  special  case  (for  A  =  0).  What  ve  have  shown  is  that  in 

this  case  we  can  extend  these  relations  of  recurrent  events  to  include 

the  ten  e  n.  Now  equations  (.4)  and  (.5)  are  just  equations  (.1)  and 

AS 

(•2)  with  the  tens  e  n  put  in  (at  least  on  the  left  hand  side).  As 
was  shown  in  the  Introduction  ( .1)  and  (.2)  are  consequenoes  of  (.15) 
and  (.16)  and  since  (2.4)  and  (2.5)  are  extensions  of  these  equations 
we  would  suspect  that  (.4)  and  (.5)  could  be  derived  from  (2.4)  and 
(2.5)  by  an  argument  similar  to  the  one  used  to  derive  (.1)  and  (.2) 
from  (.15)  and  (.16).  This  suspicion  will  now  be  verified  and  this 
will  constitute  our  first  proof  of  (.4)  and  (.5)  which  from  now  on 
will  be  called  the  basic  identity.  But,  as  indicated  in  the  introduc¬ 
tion,  we  shall  also  give  a  second  proof  which  will  show  that  ( *4)  and 
(.5)  are  direct  consequences  of  (.l)  and  (.2)  and  thereby  will  show 
that  (.1)  and  (.2)  are  equivalent  to  (.4)  and  (.5). 

At  the  heart  of  the  matter  of  why  we  may  extend  the  recurrent 
event  relations  as  we  do  here  Is  the  following  trivial  fact: 

For  the  case  of  ladder  points  equation  (.12)  holds  because  of  a 
stronger  sample  space  factorization 
(2.9)  [L^X^,...  ,1^)  =  k]  =  [1^(1^,..  .,3^)  =k]  D 

=  °J 

and  this  is  true  by  definition  of  and  the  fact  that  the  {X^  are 
independent  and  identically  distributed.  The  importance  of  this 
sample  space  factorization  will  become  apparent  as  we  proceed.  As  its 
first  use  we  derive  an  extension  ( .12) . 
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2.5  THEOREM 
Let 

(2.10)  P(Ait)  =  ?  E(eASnj  L  =  n)tn,  |t|  <  1,  Re(A)  *  0, 

n=0  ’  m 

(2.11)  Q(A,t)  =  E(e^Snj  Lm  =  0),  It  I  <1,  Re(A)  £  0, 

then  for  |xj  £  1,  |t|  <  1,  Re(A)  =  0  we  have 

(2.12)  ?  x^t*  =  P(A,tx)Q(A,t). 

n=0 

Proofs 


From  (2.9)  we  have  that 

E[eASn*Lnn=k]  =  E[flASk  eA(Sn"S3c)jLnn  =  k] 

(2*13)  =  E[eASk5Lk]c  =  k]E[eASnk}Ln_k  =  0]. 

Multiply  both  sides  of  (2.13)  by  xktn  and  snm  over  range  0£k£n  <00. 
This  gives  (2.12).  We  note  that  by  equations  (2.4)  and  (2.5),  equa¬ 
tion  (2.12)  can  be  written  as 

(2.U)  j°  I1™)  =  Ll.f^jF(A,t)  • 


We  now  prove 

2.6  THEOREM  (Basic  Identity) 

For  Re(A)  £  0,  |t|  <  1 

(2.15)  P(A,t)  =  exP(jJj^  £  ^(e^}  Sk  £  0)). 

For  Re(A)  2:  0,  |t|  <  1, 

(2.16)  Q(A,t)  s  exp( \  <  0)). 

Proof: 

First  we  show  (just  as  for  (.l)  and  (.2))  that  (2.15)  and  (2.16) 


are  equivalent. 
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For  Re(A)  =  0  we  have 


1  _  ,  00  tkq>(A)\ 

^  =  exp(  Z  - z - ) 


(2.17) 


1-  tcp(A)  -  k 


=  eapf^  Ete^jS^  £  OHexp^I^  ^  E(®^k|Sjc<  0)). 
In  (2.12)  set  x  equal  to  1  and  obtain 
(2.3.8)  i7^(Al  =  n|)  tD<P(A)n  =  P(A,t)Q(A,t). 

(2.17)  and  (2.18)  prove  the  above  assertion  and  so  to  establish  (2.15) 
and  (2.16)  we  need  only  prove  (2.15).  We  give  two  proofs. 

Proof  one  of  (2.15): 

Differentiate  (2.12)  with  respect  to  x  at  x  =  1  to  obtain^ 

(2.M)  j°  *<•*'“  W 


and  so  wb  have 


<2*20>  “  Jl  E[(1m.  -  P(A-0)  = 

Hence 

(2.21)  P(A,t)  =  exp(j? 

But  the  equivalence  principle  says 

(2.22)  E(.^nUm-ln_ljn,1])  =  E(eA3^[Nn-Nn_13)  =  £(.^,3,  2  0) 

^.=1^  “*<0 

n  '  ®n-l+  1 


if  S„  £  0. 
n 


*As  E(e^Sn  x^)  =  ,2L  E(e^SnjL  =k)xk  =  f(x)  we  have  that 

]gSQ  9  ™n 


nn  n 

|fn'(x)|  i  EL^  £  n  for  |x|  £  1,  and  so  Z^  fn*(x)tn  is  unifonnly 
convergent  in  x,  |x  |  £  1,  and  as  Z  E(e^Sn  x^Jt11  converges  for  |x|  £  1 
we  have  Z  E(eASn  x^t*  =  zJJq  E(Lm  e^n)tn  at  x  =  1.  Also 
P(A,xt)  is  differentiable  with  respect  to  x  at  x  =  1. 


V 
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Substituting  (2.22)  into  (2.21)  yields  (2.15). 

Proof  two  of  (2.15) : 

Start  with  (.1)  (Andersen’s  Lemma).  Take  logs  of  both  sides  of 
(.1)  and  equate  coefficients  of  tn  in  the  resulting  equation.  This 
gives: 


(2.23)  P-(^a  -A  21  =  1  i  P(w.  +w5  +...•*•  W.  =  n). 

n  k=l  k  1  2  * 

Let  a^,  ag, . . .  ,aQ  be  any  n  real  numbers  and  consider  the  special  case 

of  (2.23)  that  results  when  the  random  variables  Just  take  these 

.  n 

n  values  with  probabilities  p^,  p2?...jPn  (^2^  p^  -  1,  but  otherwise 
arbitrary).  Each  side  of  (2.23)  then  becomes  a  polynomial  in 
p^,P£,...,Pn.  On  the  left  hand  side  the  coefficient  of  P1P2* **Pn  is 


while  on  the  right  hand  side  it  is 


a  k=i  *  *  <a°i,ao2 . 

[^1  +w2  +...+  Wk  =  n] 


where  for  1  k  £  n  and  each  permutation 


■  (k 


2  n  \  I  (a0^,...,a0a)  denotes  the  function  which 
[Wl  +  W2  +...+\=n] 


*2  *n 


is 


1  if  the  partial  sums  art  ,  a_,  +  a .  .....  a^  +...+  art  have  their 
„  dl  °1  d2*  *  <>1  dn 

k  ladder  point  at  n, 

0  otherwise. 


r  1  if  the  partial  sum  ad  +...+  Sg  £  0, 
31.11»ly  I  =  J  1  n 

[8^0]  °  “  not- 

And  so  we  obtain  the  following  identity 

(2.24)  ijl  (■«!>•.  •>a<J|l)  =  a  {Jl  Zr  (a<Jl»#,,»a<Jn)  J  * 


tSn^O] 


[Wj  +...+  WjjS  n] 
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For  any  x  £  0  we  have  that 


(2.25) 


n  d  1  ^a°l,***,acJn^  ^^i**** 
[Sn  ;>  0]  [Sn  <;  x] 


C»n  <  ^ 


Consequently  if  X  =  (X^Xg,...,!  )  are  any  n  iwt*rffVi«mg«»Kl«i  random 
variables  we  have  from  (2.25)  by  an  argument  similar  to  that  used  to 
prove  theorem  1.7  that 


(2.26)  P(°  *  Sn  *  x)  =  2  J  P(W  +W  +...+  W  =  n$  S  £  x), 

n  k=l  * 

and  so 


(2.27) 


E( 


eASpiSn  ^  °)  =  I  J  Ete^W  +...+  W  =  n). 

n  k=l  *  1  K 


Multiply  both  sides  by  tn,  sum  and  apply  equation  (2.7).  This  results 
in 

(2.28)  f  1 21  . 


n=l 


This  is  a  version  of  (2.15)  valid  for  interchangeable  random  variables. 
If  the  {i n\  are  Independent  as  well,  then  the  right  hand  side  of  (2.24) 
can  be  written  as 

I  J  E(e^l  tWl)k  =  -ln(l  -  Efe*2*  tWl)) 
k=l  * 

and  so  taking  exponentials  of  both  sides  of  (2.28)  we  recover  (2.15). 
This  completes  the  second  proof  of  the  "Basic  Identity." 

Ve  now  establish  analogues  of  (2.15)  and  (2.16)  which  will  be 
needed  later. 

(2.29)  J?  B(eASnJLnos,|)ta  =  «p(  £  E(eASk»Sk  <  0)) 

by  (2.16)  and  (1.29). 


f 
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(2.30)  _?  K(AtM  =  OH"  =  «p(J°  f  E(.^jSk  i  0)) 

by  (2.15)  and  (1.30). 


Next  observe  that  for  the 


J 

II 

. . . .  .X  )  and  L  ( ... 

7  n  n  l7 

(2.31) 

2  tnE(e^njLn  =  n)  = 

(2.32) 

ii 

/■ — ' 
o 

ii 

PI 

€ 

wo 

(2.33) 

2  tnE(e^n:L  =  n)  = 
n  1  n 

(2.34) 

2  tnE(eASnjLn  =  0)  = 

n  11 

sequence  {^n}  we  have  L^-0^,... ,-X^) 
*,-Xn^  =  Lnn^Il,***,Xn^  3X1,1  30  WB  hav0 

"PlJH  f  E'«ASni8n  S  0)) 
e^(J1?E<e^ni3»>0)) 

exp(£.  ¥  E^nisn  >  °» 

•*£  ¥  E<*ASn;sn  £0)). 


Let  Yn  denote  the  number  of  ladder  points  at  time  n  (i.e.  Y  = 
sup  ^k:  +...+  =  n}- ).  Our  purpose  here  will  be  to  show  that  by 

similar  arguments  used  to  prove  the  basic  identity  we  may  establish 


that 

2.7  THEOREM 

For  Re(r)  *  0,  Re(|i)  =  0,  |t|  <  1,  |x|  £  1,  |y|  £  1,  we  have 

(2.36,  X  *(.*>  X1-  .*■>  =  Y.{CT]  r-W.l 

Proof: 

By  remarks  made  in  the  introduction  we  have  that  L  is  the  "time 

nn 

of  last  occurrence"  of  the  recurrent  event  "ladder  point"  and  so  if 

L  =  k  then  Y  =  Y 
nn  n  k 

and  consequently 

(2.37)  E(e^  x1™1  y*”  =  k) 

=  A(e^  =  c] 


& 
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since  knowing  that  the  last  occurrence  takes  place  at  tine  k  makes  a 
function  of  ^ 

We  hare  now  that 

(2.38)  E(e^Y*^Sk  *  k)  =  \  E(e^^Sk$W1+W2 +...+Wj  =k)y* 

J  1 

=  Z  y;lE(e(r^)(Zl+*,,+Z3)jW +...+W  =k). 
3=1  13 

Substitute  (2,38)  into  (2,37),  multiply  each  side  of  the  resulting 

equation  by  tn  and  sum  over  0£j£k£n<oo.  This  results  in 

(2.39)  Z  E(e^n+^n  y  n)tn 
n=0 

=  [I  taB(.,lS»jL  =  0)][l  E(e('*^)Zl  (xt)Wl)n 

from  which  the  theorem  follows  by  (2*5). 

Various  corollaries  follow  from  theorem  2.7  by  suitably  choosing 
the  parameters  in  equation  (2,36). 

2.8  Coronary 

(2.4D)  Z  E(e'(**n  T1*5”1  e^)  =  P(y+  p;tx)Q(|ijt) . 


2.9  Corollary 


(2,U)  E(e^  7  n)tn  =  Y  l\  1.yE(er^ltWl) 


2.10  Cnmnarv 


(2.4 2)  Z  E(e  *)t‘ 

n 


1-t  l-E(e^ltwl) 


Rama-rVn : 

The  idea  of  studying  the  sequence  of  bivectors  "{(Z^jW^jy  is  due 
to  Dwass  who  used  them  to  prove  (2.42)  by  an  argument  similar  to  the 
argument  used  here  to  prove  theorem  2*7.  In  fact  Dwass  shows  that  if 
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{(Z^jWjpy  are  independent  and  identically  distributed  bivectors  with 
the  {W^  positive  integer  valued,  then  if  we  define  I  as  above  and 
=  Z^  +  Zg  +...+  Zy  (which  it  is  in  the  special  case  above)  then 
(2,37)  holds,  [in  this  regard  we  nay  say  that  for  arbitrary  {(Z^,W^)j- 
of  the  type  mentioned  above,  the  special  case  of  theorem  2.7  with  p.  =0 
is  valid.]  Dwass  uses  equation  (2.37)  to  prove  (.3)  (with  y  =  0)  by 
complex  variable  arguments. 

The  idea  of  looking  at  random  variables  taking  values  a^^,...^ 
to  prove  permutation  identities  is  due  to  Wendel  who  uses  it  to  prove 
permutation  identities  in  [l7]  and  [l8].  In  Chapter  5  we  will  use  it 
again  to  prove  another  permutation  identity. 

The  permutation  identity  (2.24)  is  due  to  Feller  and  was  estab¬ 
lished  by  him  by  a  direct  argument  in  [9].  He  uses  it  to  prove  the 
basic  identity  as  we  do  here. 

The  basic  identity  and  Spitzer's  identity  (.3)  are  equivalent,  as 
is  easy  to  verify  from  equation  (2.40).  Our  second  proof  of  the  basic 
identity  shows  that  it  and  Andersen's  identity  ^.l)  and  (,2j  are 
equivalent. 

Finally  let  us  remark  that  the  basic  identity  shows  that 


S>  =  n)  =  «♦<*>*>  *  —  E(.M1  t*l) 


ng  =  0)  =  g_(A,t) 


1  n  *Wll 

1  -  tcp(A) 


and  so  in  the  future  g+  and  g_  can  be  replaced  by  the  right  hand  side 
of  the  above.  In  particular  the  exponential  identities  show  that  we 
may  express  generating  functions  of  the  various  quantities  of  interest 
in  fluctuation  theory  in  terms  of  E(e^^  t^). 
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Chapter  3 

Direct  Consequences  of  the  Fundamental  Identity 


The  following  notation  will  be  used  throughout  the  remainder  of 
this  paper. 

(3.1)  P(Ajt)  =  ?  ECe^jN  =  n)tn 

n=0  n 

[Note  by  (1.26)  this  agrees  with  the  original  definition  in  (2.10)] 


(3.2) 

Q(Ajt)  = 

JL  E(eASllj: 
n=0 

(3.3) 

g+(Ajt)  = 

00 

V : 

(3.4) 

g_(A|t)  = 

«*<A  n  1 

(3.5) 

H(Ajx,t)  = 

I 

n= 0 

In  the  above  and  in  the  following,  Greek  letters  A,  a,  p,  y>  11  j  etc. 
will  denote  complex  numbers  whose  real  parts  are  zero.  [Sometimes  as 
in  (3.4)  for  example ,  the  range  of  A  can  be  greater  but  this  will  not 
concern  us  here.]  t  will  always  be  a  complex  number  such  that  |t|  <1 
while  letters  u,  v,  w,  x  will  denote  complex  numbers  such  that  their 
absolute  values  are  £  1. 

For  any  quantity  a,  either  constant  or  random, 

+  r  a  if  a  £  0 

a  t  0  if  a  <  0 

(3.6)  _  ,a  if  a  <  0 

a  <0  if  a  £  0 


-c 


and  finally 

(3.7)  cp(  A)  =  Ee 

The  following  theorem  was  discovered  by  Baxter  [4]  (see  also 
Spitzer  [l6]). 
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3.1  THEOREM 

(3.8)  E(eAZl  tWl)  =  1  -  exp(-2?  ^  Efe^S.  2  0)). 

k=l  *  * 

Proofs 

This  is  just  equation  (2.4)  turned  upside  down. 

3.2  THEOREM 

(3.9)  lEte^x^t”  =  g^ApctJgjAjt). 

Proofs 

(3.9)  is  just  (2.14)  rewritten  using  the  equivalence  principle. 
[The  special  case  of  A  =  0  is  due  to  Andersen  [3],  the  theorem  as 
presented  here  can  be  found  in  Baxter  [6].] 

3.2.1  Corollary  (Andersen  ll],  Wendel  [l8]) 

(3.10)  Ete^j^  =  k)  =  =  kMe*3^^.*  =  0). 

Proof  s 

(3.10)  is  just  equation  (2.13)  rewritten  using  the  equivalence 
principle . 

Let  Mn  =  Max(So,  S^,...,Sn) 

Hn  =  M1i,(3o>  S1 . Sn). 

3.3  THEOBIM 

(3.11)  Z  tMe*3**1*0  x1®)  =  (Ajt) • 

n=0 

Proofs 

Lwn  3  k  if  and  only  if  and  so  by  factorization  (2.9)  we 

have 

«*]  „  =k] 

7  nn  7  nn 

=  =  kMe^'V^  -  0]. 


(3.12) 
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Multiply  both  sides  of  (3.12)  by  x^tn  and  sum  over  0£k£n<oo  to 
obtain 

(3.13)  ®  =  P(A*Wrt)«(A,t). 

n=0 

Ths  theorem  now  follows  from  the  basic  identity. 

This  theorem  has  a  long  history.  The  special  case  of  x  *  1  is 
the  basic  theorem  of  Spitzer  [l4].  The  case  of  A  =  0  was  proved  in¬ 
dependently  by  Pollacaek  [l2] .  Proofs  for  x  =  1  were  also  given  by 
Baxter  [4,6],  Wendel  [l7],  Kemperman  [ll]  and  Dwass  [private  communi¬ 
cation]  . 

3.3.1  Corollary  (Spitzer  [14]) 

(3.14)  *  B[eA(S*A)  +  P*^]tn  =  exp(  Z  ^(Ee^11  ♦Be^11)). 

x“'c  tf=0  n=l  n 

Proofs 

Set  x  =  1  and  write  p  =  {3  -  A  in  (3.11).  This  gives 

(3.15)  t^S(eA(Stf^)  +  P^ll)tn*  ^(PjtJgjAjt). 

Multiply  both  sides  by  1/(1 -t)  and  use  (.20). 

3.3.2  Cflgallag  (Spitzer  [l4]) 

(3.16)  Ete^Jt11  =  g+(pjt)g_(0jt)  =  exp( ^  EU**3*1  ]). 

Proofs 

Set  x  =  1  and  A  =  0  in  (3.1 1). 

3.3.3  Corollary  (Andersen  [2],  Spitzer  [l6],  Kemperman  [ll]) 

(3.17)  0,3^0)  “  P(V°». 

Proofs 

Set  x  =  1  in  (3.1l)  to  get 

(3.18)  f  tnE(eASn+^n)  =  g+(A  +  p$t)g_(A$t). 
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Observe  that  since  Mn  £  0  this  formula  is  valid  for  all  complex  p  such 
that  Re(p)  <J  0.  Taking  the  limit  as  Re(p)  -oo  on  both  sides  of 

(3.18)  to  obtain 

(3.19)  tnE(eASn}Mn=0)  =  g_(A,-t)exp(  ?  £  P(Sn=  0)). 

Now  (3.19)  is  valid  for  all  complex  A  such  that  Re(A)  £  0.  So  taking 
the  limit  as  Re(A)  ->  co  on  both  sides  of  (3.19)  yields  (3.17).  [Note 
the  order  of  limits  here  is  essential.] 

Let 

(3.20)  f+(Ajt)  -  exp(J?  fc-  E[e^}Sk  >  0]). 

The  following  theorem  is  due  to  Kemperman  [ll]. 

3.4  THEOREM 

2  xLnn"I“  fy 

n=0 

(3.21)  00  (+T\a 

=  f+(A  +  pjty)g_(A$t)exp(  ““  P(Sn=0)). 

Proof: 

The  proof  is  based  on  the  decomposition  shown  below: 
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(3.22)  [Ln=  J,  lm-ln=k]  =  =  3]n 

[Vk-sr0'  sk<Im-sj>->Vic-33>  =  0]n 

J  *k*l>  *  •  •  = 


and  thus 


(3.23) 


E(e*WSVJ)  Lm-Ln=k) 


=  ,  ^[^n-J-k.^-^^  =  n.j.k] 

p(\  =  0,  ^  =  0). 


j  n 

Multiply  by  yJx  t  and  sum  over  0£j£n<a>,0£k£n<oo  to  ob¬ 


tain  the  result 


(3.24) 


f  t”E[e“nn^  xWI“  y*V 

n=0 

=  [l(7t)”E(e(A+,l)S,1iN+=n)][  2  tMe^H  ^n]]- 

n=0  n  rt^O  n 


[  2  P(S  =0,M  =0)(tx)n]. 

n=0  n  n 

Use  of  (1.27)  and  (2.34)  in  the  first,  (1.28),  (1.29)  and  the  basic 
identity  in  the  second  and  (3.17)  in  the  last  of  the  bracketed  terms 
of  (3.24)  yields  the  desired  result. 

3.5  THEOREM  [indersen  [3]>  Baxter  [6]] 

(3.25)  2  E[e^*n  xnfin±0]tn  =  jjh  fl-  [l-  ^(AJlJ-^Ajijt). 

n=l 

Alternately  we  may  write  the  right  hand  side  of  the  above  as 


^  _X_  r,  g+U»tx)  ■) 

(3.26)  in  l1  -  g^djtT  J 


Proof: 
We  have 
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(3.27)  [Nn  =  mjSn  *  0]  =  [Hn  £  m]  -  [N^  *  ■]• 

A  simple  calculation  gives  that 

(3.28)  ?  B(eASnj^  2  a)xm  =  S<^  "  • 

Consequently  we  have  from  (3.27)  and  (3.26)  that 

?  xN”,s  a  o) .  r  x%) 

n=l  ’  n  n*l  1  "  x 

-  ?  tn  EleA3n-l~  ^)E(<>A3n-".1.  lOl  h  =  ^{l-  [l-xfc(p(A)]H(Ajx,t))-. 


(3.29) 


Using  (2.17)  and  (3.9)  on  the  right  hand  side  of  the  above  we  obtain  (3.26). 

[Remarks  It  is  convenient  to  take  E[e^°  x^°$So  £  0]  =  0  here  and  oonse- 

AS  N 

quently  ue  must  take  E[e  0  x  °$SQ  <  0]  =  1  in  order  to  be  consistent  with 
the  fact  that  E(e^S°  x°)  =  1.] 

3.6  THEOREM 

(3.3°)  £  tnE(eASn”  +  )jSn  +  PSn  xS 

n=0 

-  [~“  H(A  +  ji$x,t)  -  ^f^l-  t«p(]i+  p)]H(p+  P,x,t). 

In  the  future  we  will  denote  the  left  hand  side  of  (3.30)  by 
G(A,ji,Pjx,t). 

Proofs 

G(A,]x,jJ-,x,t)  *  f  tnE(e(^1+P)3n  xNn5Sn  £  0) 

(3.31)  +  £  tnE(e^+)1^Sn  xNnjS  <  0) 

ri=0  n 

3  r?x  i1-  Cl  -  tq>(>!+  p)]H(p  +  Pjx,t))-  +  H(A+  jijx,t) 

+  jl  -  [l-t«p(A+  p)]H(A+p$x,t)} 
by  theorem  (3.5).  Simple  rearrangement  now  gives  (3.30). 
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3.6.1  Corollary 
(3.32)  G(A,ji,Pjx,t) 


1  rg-U  +  pjt)  g+(ft  +  P  j^rb)1 
i-x  Lg_(A+ jijxty " x  g^ir^TjtTJ 


Proof : 

This  follows  from  the  theorem  by  use  of  theorem  3.2. 

3.6.2  enroll ATnr 

(3.33)  “  tW3”1  xH”)  =  5-1-  [f=7^r  -  X 

n=0  1“x  8_v-p,xt;  g+(p,t) 


Proof: 

Set  p  =  0  and  A  =  -p  in  (3.32). 


Chapter  4 

Order  Statistics  of  Suns 

i  - 

*1 

|  In  the  previous  chapter  we  dealt  with  the  quantity  which  is 

i 

i 

|  the  number  of  non-negative  sums  among  the  first  n  sums.  In  this  chap- 

|  ter  we  will  investigate  the  quantity  Tn(x)  which  is  the  number  of  sums 

i  ■  • 

!  among  SQ,  S^,...,Sn  which  are  less  than  or  equal  to  x.  This  study  will 

i  : 

lead  us  to  investigate  the  order  statistics  Rn0  £  R^  &  ***  £  Rm  of 
the  first  n  sums,  which  in  turn  will  lead  to  the  study  of  certain  re¬ 
lated  quantities  {L^  to  be  defined  shortly. 

■  Whenever  one  has  to  deal  with  order  statistics  one  runs  into  dif- 

|  ficulty  in  determining  which  object  stands  kth  from  the  bottom  (or 

top).  This  is  due  to  the  possibility  of  ties.  One  way  of  avoiding 
these  difficulties  is  to  eliminate  them  by  use  of  certain  conventions. 
In  our  case  this  may  be  accomplished  by  use  of  the  following  order 
relation. 

4.1  Pqf&BlUffl 

Say  3^-<Sj  (read  "is  smaller  than")  if  Si  <  or  but 

i  <  j. 

With  this  ordering  of  the  sums  every  sum  has  a  unique  position 
and  we  may  define 
|  4.2  Daf-l ration 

I  For  each  k,  0  £  k  £  n,  let  denote  that  sum  which  is  k**  from 

the  bottom  according  to  the  ordering. 

4.3  Definition 

The  — <  ordered  sums  will  be  denoted  byR  ^*<R  R 

no  nl  nn 

! 

f 
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Note  that  Rn0  £  R^  £  . . .  £  R^  and  that  R^  =  S  ^  if  and  only  if 
L,*  s  j ,  and  that  RnQ  is  the  first  and  is  the  last  oaxiauiB* 

Thus  Lqo  is  the  index  of  the  first  jgjjliJBffl  and  is  the  index  of  the 
last  maxlmup.  These  agree  with  the  definition  of  Lqo,  given  pre¬ 
viously  and  explain  why  the  notation  L _ ,  L _ was  used  before  for  these 

no'  nn 

quantities. 

The  relation  between  the  function  T^(x)  and  the  {R^y  will  now  be 
established. 


We  have 


(4.D  =  -<!-)! 

W-OO  *  Jr=0 

and  so 

u-*)1  I 


1 00 
-00 


.4*  ^  E,T»(i> 


=  -(1-  y)  £  EeAB”I[  yk. 
k=0 


n  ARnV  1c 

In  this  way  we  are  led  to  study  the  function  Z  Ee  v  . 

]c=0 

In  an  analogous  manner  if  we  investigate  the  function 

f00  Ax  Tn(x)  n  AI Cv  k 

J 0-  ©  dx  v  we  will  be  led  to  study  the  function  22  Ee  ^  v  , 


by  the  relation 
too 


.Al  dT  By‘n 


Tn(x)  .  n  v  , 

=  -(l-  v)  Z  v  Ee 
k=0 


JflOC 

<r 

An  alternate  characterization  of  the  R^  is  that  they  are  the 
order  statistics  of  ^So,S^+,...,Sn+}.  Similarly  the  order  statistics 

mm  fi  0+  A  T  1 3C) 

of  {So,S^  , .  * .  ,Sn  J-  or  the  funotion  J_Qo  e^  d^  v  n  leeui  to  the 
study  of  the  function  ?  v^E  e^1^.  Also  of  interest  is 

]c=0 

£  ykE/'^P3-. 

lc=0 


exchange  in  order  of  integration  is  trivial  to  verify  here 
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We  will  ,  show  below  that  simple  considerations  of  the  order  Indices 
Lnk  will  lead  to  an  exponential  identity  which  contains  identities  for 
all  of  the  variables  mentioned  above  and  in  fact  all  known  identities 
may  be  derived  from  it.  We  will  deduce  many  special  cases  of  formulas 
involving  the  order  statistics  from  it.  The  key  to  this  study  is  con¬ 
tained  in  the  following  sample  spaoe  factorization: 

min(j,kK 

(4.4)  -  *-dn 


c(0,j+k-n) 

=  x]. 

To  prove  this  (see  diagram  below)  observe  that  the  event  [L  .  =  j] 


(0  £  k  £  n),(0  £  j  ^n),  can  happen  dis jointly  as  follows:  Among  the 
sums  So,S^,...,Sj_^  there  are  x  which  are  less  than  or  equal  to  3^  and 
among  the  sums  S^+1,...,Sa  there  are  k-x  which  are  less  than  [here 
max(0,j+k-n)  i  x  i  min(j,k)].  This  first  event,  [among  So,...,Sj_1 
there  are  x  sums  £Sj]  —  [N^  (X  ^ , . . .  ,1^)  =  x]  while  the  last  event, 

[among  there  are  k-x  sums  <S  ]  =  [N~^(lj+1,...,In)  =k-x]. 

Hence  (4*4)  •  From  this  sample  space  factorization  we  obtain  Immediately 
the  following  lemma. 


4.4  IEMMA 
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+  P^nk  +  ‘,'Rnk  +  V^n.L  _ 

(4.5)  r  AS.  +  pS*+ ySj  +  u5i  „  -,  _r  v3n-1  »-  ,  n 

=  2  E[e  3  3  1  J  ^3jN.=x]  E[e^n  3jN  =  k-x]. 

x  3  n"3 

Define 

(4.6)  J(Ajv,t)  =  2  v*Stn 

n=0 

then  we  have 


4.5  LEMMA 


(4.7) 


=  G(A,jx+ Y,Piv,tu)J(|ijv,t). 


Proof: 

Multiply  both  sides  of  (4.5)  by  ta  u^  v^  and  sum  over  the  range 
0  ^  j  i  n>  °£k^n,  0  <;  n  <  oo .  This  results  in  the  desired  left 
hand  side  while  the  right  hand  side  becomes 

{j°  *[/*;  4ps3  *  (p^)s3  j(PjT,t). 

Theorem  3.6  now  gives  the  result. 

Finally  we  have  the  big  theorem.  This  theorem  is  important  be¬ 
cause  from  it  all  known  identities  may  be  deduced  by  a  suitable  choice 
of  A,  p}  Y,  Pj  u  and  v.  Some  of  these  will  be  derived  as  corollaries 
following  the  proof  of  the  theorem. 


4.6  THEOREM 


oo  _  n 
I  t  Z 
xfO  k=0 


LX-  vut9(A^p-*-  Y/J  g+(A+p+Yjutv)g_(A  +  p+ Yjut) 

“  j^[l-ut<p(p  +  y+  P)]&f(p  +  Y+  Pjutv)g_(p  + y+  P»ut)} 
•  «+(p,t)g_(pjtv) . 


(4.8) 


that 


Proof: 

This  follows  directly  from  Lemma  4*5  and  Theorem  3.6  and  the  fact 


J(ji,v,t)  =  g+(p,t)g_({i,tv). 

This  latter  fact  follows  from  (1.28),  (1.29)  and  (1.30),  and  the  basic 
identity  [and  is  an  obvious  analogue  of  Theorem  3.2]. 

We  may  rewrite  the  right  hand  side  of  (4*8)  as 

( ,  o\  f  gjA  +  p  +  yjTit)  _  g+(p  +  Y+Pjutv)'>  g+(p>t)g..()ijtv) 
i  g”(A  +  p  + Yjutv)  g+(ji+  y+  Pjut)  )  1  -  v 

4.6.1  Corollary  (Wendel  [l8]) 

U.  w)  z  tn  ?  TkEr»AB^k*p3'1]  =  pS°>)  -T  . 

(4'10)  Jo  *  Jo  ™Le  1  (1  -  v)Ll  -  rfcp(|i)J 

Proof: 


Set  p  =  y  =  0  and  u  =  1  in  Theorem  4*6  end  (4*10)  follows  upon 


rearrangement . 


4.6.2  Corollary  + 

(4.n)  ? 

fi=0  k=0  (1  -  y)(l  -  tq >(ji)) 


n=0  k=0 

Proof: 


Set  A  =  y  =  0,  u  =  lin  Theorem  4.6  and  after  a  little  algebra  in 
thB  resulting  equation  we  obtain  (4.H)  • 

4.6.3  Corollary  (Barter  [6]) 

tnJo  ^  >] 

Proof: 

Set  p  =  A  =  0  in  Theorem  4*6. 
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4.6.4  Corollary  (Wendel  [l£],  Baxter  [6]) 

Jo  ’]Jo  +  ^  =  g+(r  +  H,vt)gJpjvt)g+(pjt)gJ y  +  HJt) 

U,13>  =  «p( *  £  *<.*»**»». 

Proof: 

Set  u  =  1  in  Corollary  4.3.3. 

4.3.5  enroll are  (Wendel  [l8]2) 

J£  *</“  ^  «,  >U)) 

(4-U)  =  (1  -  tW^  «•+*)  *  i  ^})  • 

Proof: 

Apply  Corollary  4.6.4  and  (4.l) • 

Though  other  identities  could  be  derived  from  Theorem  4*6,  as  the 
ones  above  were  derived,  we  shall  not  derive  them  here  but  will  conclude 
instead  with  a  version  of  Spitzer's  identity  which  will  be  needed  in 
the  next  chapter. 

4.3.6  Corollary  [See  Theorem  3.3  for  references.] 

(4.15)  ^  ^  a1*00]  =  g_(y+ Wut)g+(pjt). 

-  Proof: 

Let  v  =  0  in  Corollary  4.6.3. 

Up  till  now  we  have  always  taken  Sq  as  the  constant  0.  However 
we  may  easily  modify  the  preceding  formulas  so  that  SQ  can  be  an 
arbitrary  random  variable.  In  other  words  we  add  to  the  sequence  {X  \ 


^Wendel  studies  the  function  n-Tn(x)  and  obtains  the  corresponding 
formulas  in  terms  of  the  descending  order  statistics. 


n  >  1,  a  new  random  variable  I  so  that  S  =  X  ,  and  In  general 

O  0  o 

Sk  ■  *0  ♦  h  *— *■  \- 

^  Sl>32>*">Sn  to  the  X1>  Xi  +  X2»**.>^k  +...+  in  as  usual.  Than 
if  we  add  a  term  XQ  to  each  of  these  sums,  the  relative  order  of  these 
sums  is  unaffected  (see  diagram)* 


Add  X 

o 


That  i3,  is  as  before  and  RwV  is  the  order  statistics  of 

X  +  S  j,,, ,X  +  S  then  R  ,  /v/  X  +  R  , 
o  l7  1  o  n  nk  o  nlc* 

i*e  •  R_j,  has  the  same  distribution  as  X  +  R  ,  •  We  assume  of  course 
1  o  nic 

that  Xq  ia  independent  of  X^X^...  and  therefore  of  the  {R^  but  in 
general  XQ  may  have  a  different  distribution  than  the  common  distri¬ 
bution  of  the  Xn,  n  j>  1.  As  an  example  of  the  use  of  this  idea  we 
have  the  following  theorem. 

4*4  THEOREM 

?  tn  Z  vk  E[eV1,n,k+^n] 
nO  k=0 

a  E[e^^X°]  2  tn  Z  v^£E[e1fRnk  +  ,lSn] 
n=0  k=C 

=  +  ^  ♦  £  E(.lSn  ^)>). 


Chapter  5 

An  Extremal  Factorization 


All  of  the  identities  in  the  preceding  chapters  were  in  a  certain 


sense  consequences  of  the  factorization 


(5.1)  E(.'"nil,m=  k)  =  E<«^i^  =  lO-E(e^Vn..k,n_k  =  0) 

and  its  partner  under  the  equivalence  principle 

(5.2)  Et.^jN^k)  =E(.ASk!llk=k)-E(eAS&*SNn.Jc  =  0). 

Another  such  factorization  is 
5.1  THEGRSM 

(5.3)  E[.lEl*+pSl‘  a1**]  =  E[elRkk*PS,£  uI“].E[e1|S,1‘lc>0*PSlric  A*’0]. 
Proof: 

By  Corollary  4*6.3  we  have 

J°  A[e'|ii^  +  pSn  >*] 

=  ^(r+ixjutvJgJjijvtJjCgJr+iiju^g+^t)]. 

But  hy  (4.15)  and  (3.11)  this  first  term  in  brackets  is 


while  the  last  bracketed  term  is 


and  thus  we  have 


k^) 

<5-4)  =  ?  Ate***  uLkk)E(,pSn-k*',t!o-k  >-k>°) 

and  equating  coefficients  of  v^  in  (5.4)  yields  the  result. 
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5.1.1  Corollary  (Wendel  llS’J) 

(5.5)  KCe1*^  *  =  Ete^  *  *  pSn-1‘] 

(5.6)  EC.1*”1']  =  E[8^]E[elH,1-l‘]. 

Proof: 

Set  u  =  1  In  the  theorem  to  obtain  (5.5)  and  set  ji  =  0  in  (5.5) 
to  obtain  (5.6). 

5.1.2  Caggllag 

(5.7)  ECu^]  =  E[uLkk]E[uLn“k,°]. 

Proof: 

Set  y  =  |i  =  0  in  the  theorem. 

An  alternate  direct  approach  is  possible  to  the  theorem  5.1  which 
will  be  given  below.  From  Theorem  5.1  we  may  prove  Corollary  4.6.3 
and  this  will  present  a  more  direct  and  simpler  proof  of  that  important 
identity.  We  start  as  in  Chapter  4  with  the  identity 

(5.8)  EU^iH^.k-x], 

Now  by  (5.2)  and  an  obvious  analogue  for  Nr  we  have  that  the  right 
hand  side  can  be  factored  as 

Z  Ete^^jN  =  x]E[e^+YjSJ^jN.  =  OjEte^-^N "  =k- x] 
x  x  3**x  jc-x 

but  aa 

V0<^*jVJ-x 

W  1=-X«=>>W“0 

we  have  combining  the  first  and  third  bracketed  terms  together  and 
the  second  and  fourth  bracketed  terms  together  by  yet  another  ap¬ 
plication  of  (5.2)  and  the  Equivalence  Principle  that 
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(5.9) 


=  2  E[e^*M3ijLka[=i]Ete1,fe-k*,lSn-ki 


>ln-k,0  =  i-l] 


from  which  (5.3)  is  evident. 


Multiply  (5.3)  by  vt  and  sum  over  0  £  k  £  t  <  oo  to  obtain 
Corollary  (4.6.3). 

We  will  now  deduce  an  interesting  permutation  identity  from  (5.3) 
by  the  same  trick  of  Wendel  used  in  Chapter  2. 

Let  a  =  (a^jSLj,... ,an)  be  any  n  real  numbers.  For  a  fixed  integer 
k  let  be  any  of  the  (£)  subsets  of  the  set  {l,2,...,ny  consisting  of 

k  numbers,  say  {ipig,...,!^  •  Let  d  be  an  arbitrary  permutation  of 
1,2, , .  .,n  and  let  tt^,  tr^,  denote  arbitrary  permutations  of  and  its 
complement  D^'  respectively.  Define  R^Ca),  L^Cda)  on  the  sums  of 

Vx5*  WV’  Vk^X’5  0X1  the  3131113  of 

(a1;L,..,,aik)  and  (a^,.,.,*^)  TeB^ect±7e1^^  where  i1!*  —  *  *!>••• » 3n-J 

=  {l,2,.,.,ny.  We  then  have  the  following  theorem: 

5.2  THEOREM 

There  is  a  1-1  mapping 

O  <->  (v\> 

of  the  so t  of  nl  permutations  d  of  (l,2y..*,n)  onto  the  set  of  triples 
fak’X*  X’>  sucil  tha-fc  the  sector  (Rrit(da),Lnj£(da))  is  carried  onto 
the  vector  sum 

^X^L^*Dk^  +  X'  ^  ,Ijn-Jc,0^  X'  ^  ^  * 


Remarks :  Of  course  the  theorem  holds  coordinate  wise  and  for  the  first 
coordinate  was  proved  in  Wendel  [l8],  >*0  however  attributes  the 
theorem  to  Spitzer.  One  interesting  thing  of  this  theorem  is  the 
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k 


(5.10) 


somewhat  surprising  fact  that  the  permutation  works  for  each 
piece  of  the  vector.  [Of  course,  owing  to  the  relation  of  and 
Sic  this  is  what  one  would  expect.] 

Proof: 

Set  |t=  0  in  (5.3)  to  obtain 

g[e1f*nk  uIWc]  =  E[e^(Xlv.,Xk)  +Un-k^k+lv«:^n^ 

1^(11,. ..,Xk)  +  ^n-k,o(^k+l»  *  ••J^n^-i 
•u  '  J. 

If  the  {Xn>  take  values  a^,...,an  with  probabilities  p^, . ..,pn  then 

(as  usual)  by  equating  the  coefficients  of  on  eac^ 

we  obtain  the  identity 

2  eYRnk(0a)uLn]c(Ca)  =  ^  +^-k(TrV)] 

(5.11)  * 

#  uIVk(  ^  +  ^-kjO^Dfc’ ^ 


Since  u  and  y  are  arbitrary  the  vector  identity  follows  from  (5.1l). 

Example.  a  =  (1,-1, 2) 

I  =  (X^X^X^)  a  rearrangement 


*1 

X2 

S 

S 

0 

S1 

S2 

•j 

R30 

R31 

R32 

*33 

L30 

Si 

L32 

L33 

1 

-1 

2 

0 

1 

0 

2 

0 

0 

1 

2 

0 

2 

1 

3 

1 

2 

-1 

0 

1 

3 

2 

0 

1 

2 

3 

0 

1 

3 

2 

-1 

1 

2 

0 

-1 

0 

2 

-1 

0 

0 

2 

1 

0 

2 

3 

-1 

2 

1 

0 

-1 

1 

2 

-1 

0 

1 

2 

1 

0 

2 

3 

2 

-1 

1 

0 

2 

1 

2 

0 

1 

2 

2 

0 

2 

1 

3 

2 

1 

1 

0 

2 

3 

2 

0 

2 

2 

3 

0 

1 

3 

2 

For  sets  of  no  elements  Dq  and  all  3  numbers  there  is  nothing  to  do. 


Si 

“l 

S 

S 

0 

s 

S' 

S 

0 

S1 

S2 

*2 

**20 

1 

1 

1 

0 

1 

-1  2 

0 

-1 

1 

-1 

1 

1 

1 

1 

0 

1 

2  1 

0 

2 

1 

0 

0 

0 

0 

-1 

0 

-1 

1  2 

0 

1 

3 

0 

0 

0 

0 

-1 

0 

-1 

2  1 

0 

2 

3 

0 

0 

1 

2 

2 

0 

2 

-1  1 

0 

-1 

0 

-1 

1 

1 

2 

2 

0 

2 

1  -1 

0 

1 

0 

0 

0 

Chapter  6 

An  Analytic  Method 

In  this  chapter  we  present  an  alternate  approach  to  the  basic 
identity  and  theorem  3.2  based  on  complex  variable  arguments.  This 
method  seems  to  have  first  been  used  in  Fluctuation  Problems  by 
D.  Ray  [l3].  Spitzer  [l4]  uses  it  to  prove  theorem  3.1.  The  method 
came  to  my  attention  through  M.  Dvass  who  used  it  to  prove  corollary 
3.3.2.  The  method  is  expounded  in  detail  in  Kemperman  [ll]  who 
proves  (as  we  will  here)  theorem  3.2  by  its  use.  Our  purpose  in  pre¬ 
senting  this  method  here  is  illustrative}  we  wish  to  illustrate  one 
of  the  analytic  approaches  to  the  theory.  Since  the  other  analytic 
methods  are  equivalent  we  choose  this  method  since  it  is  the  most 


elementary  of  them. 

(6.1) 

1st  <p(A)  =  Ee**1  Be(A)  =  0 

(6.2) 

F(Ajt)  =  J,  ■  -It1 

1  Re(A)  £  0 

(6.3) 

Q(Ajt)  =  J,  =  0] 

1  Re(A)  2  0 

(6.4) 

g^(Ajt)  =  exp(  2  E{s'^kjS. 

k=l 

a  o)) 

Re(A)  0 

(6.5) 

g„(Ajt)  =  exp(^i  ^  E(eASk}S]c 

<  o)) 

Re(A)  2  0. 

Now  it  is  easy  to  verify  that  P(A,t)  and 

(A,t)  are  bounded 

and  continuous  for  Be (A)  £  0  and  analytic  for  Re(A)  <  0  and  that 
Q(A,t)  and  g  (A,t)  are  bounded  and  continuous  for  Be(A)  2  0  and 
analytic  for  Re(A)  >  0.  By  (2.18)  we  have 

(6.6)  gjA,t)g+(A,t)  =  fr^TXT  =  for  »»(A)  =  0 
and  so 
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(6.7) 


- tM  for  Hs(A)  ■  °- 


Hence  by  Liouville ' s  theorem,  f  (A)  must  be  a  constant.  To  evaluate 
this  constant  observe  that 


1  im 

Re(A)— >  od 


g-(A,t) 

Q(A,t) 


1 


and  therefore  we  have  the  result 


P(A,t)  =  g.(A,t) 

(6.8)  #  „  ,  , 

Q(A,t)  —  g  (A,t) . 

We  next  prove 

2  Ete^11  xNn]tn  s  g  (A$xt)g  (Ajt). 
n 


Of  course  this  follows  from  (6.8)  directly  by  use  of  the  equivalence 
principle  but  we  wish  here  to  prove  it  directly  and  then  deduce  the 
equivalence  principle  from  it. 

Let 

(6.9)  H  (Ajx,t)  =  2°  ECe^11  x^jS  2  °]tn 

n=0  11 

(6.10)  H  (Ajx,t)  =  2  xnfi  <  0]tn 

n=0  n 

and 

(6.11)  H  =  H+  +  H_ 


then  theorem  3.5  gives 

(6.12)  H+  =  ^{1-  [1-  tcp](H+  +  H_)}  Re(A)=0 

or 

(6.13)  Ll  -  t*p]^  ♦  (1  -  t<p)H_  =  1. 

Add  j-*^(l  -  tcp)  to  each  side  and  sifter  slight  rearrangement  we 


obtain 
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H 


(6.14)  [l  -  t*p]  -  -£■}  =  (l  -  tcp)jH_  +  5^} 


or 


/,  r  1  .  H+,  g+(A,t)  g_U,tx)  r-  .  xi 

(6.i5)  *  -} 

It  can  be  seen  that  H+  is  bounded  and  analytic  for  Re(A)  <  0 
and  continuous  on  He  (A)  =  0  and  that  H_  is  bounded  and  analytic  for 
Re(A)  >  0  and  continuous  at  Re(A)  =  0.  Henoe  (6.15)  represents  a 
bounded  analytic  function  of  A  and  therefore  is  a  constant.  To 
evaluate  this  constant  take  limit  as  Re (A)  oo  on  the  right  hand 


side  of  (6.15).  This  results  in  1  + 
Solving  for  H+  we  get 


1-x 


1-x  * 


H+  =  -[l  -  [(l  -  t(p)]g+(Ajtx)g_(A,t)}. 

Substitution  of  this  expression  in  (6.12)  and  solving  for  H  yields 
the  result. 

We  may  use  these  two  theorems  to  deduce  the  equivalence  prin¬ 
ciple.  For  the  two  theorems  just  proved  show  that 

(6.16)  Ex1®”  =  Ex"® 


and  so  for  any  k,  0  £  k  <[  n, 

(6.17)  P(L  =  k)  =  P(N  =  k). 

nn  n 

If  we  apply  (6,17)  to  the  random  variables  taking  values 
a^,a2,,..,aft  with  probabilities  p^,...,p  then  by  equating  coef¬ 
ficients  of  p^,p2,...,pn  on  each  side  of  (6.17)  for  this  special  case 
results  in 

1 1  («<>,,. ..,««_)  »  j  i  (■o,i."i%) 

[^  =  >0  « 

which  is  the  permutation  version  of  the  equivalence  principle. 
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